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thermodynamic properties as the four-state anisotropic Potts-glass neural network model. This 
equivalence is not seen at the level of the Hamiltonians. 
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It is well-known that the classical Ashkin- Teller (AT) 
model is a generalization of the Ising, the four-state clock 
and the four-state Potts models. This can be easily seen 
already at the level of the Hamiltonian, especially when 
one rewrites the Hamiltonian of the AT model using 
two Ising spins located at each site of the lattice inter- 
acting via two- and four-spin couplings |^ . 

For spin-glass systems similar observations can be 
made ( and references therein). The AT spin-glass 
Hamiltonian contains as particular limits, for certain 
bond realizations, both the four-state clock spin glass 
and the four-state Potts-glass Hamiltonians. 

Concerning neural network models, the situation is 
more complicated. It is straightforward to see at the 
level of the Hamiltonian that for two, respectively one of 
the coupling strengths taken to be zero, the AT neural 
network model |^,^ is equivalent to the Hopfield model 
1 3| respectively the four-state clock neural network model 
|7|. On the contrary, the possible relation with the four- 
state Potts neural network models existing in the liter- 
ature is, at first sight, unclear. However, since we 
discovered in the study of the thermodynamic and re- 
trieval properties of the AT neural network |4[|^ for equal 
coupling strengths some resemblance to the properties of 
the Potts-glass neural network |]^,|lOt, we expect that a 
relation with the latter does exist. To investigate this 
relation is the purpose of this brief report. 

The AT neural network with the Hebb learning rule is 
described by the following infinite-range Hamiltonian 
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p N 



A'^i (»,i)=i 



with the two types of Ising neurons Si,(Ti,i = 1, . . . ,N 
describing the state of the network. In this model stor- 
age and retrieval of the patterns i^^}, {?7f }, M = 1; • ■ • 



are studied. The patterns are randomly chosen con- 
figurations of the network. Based upon our observa- 
tions mentioned above we take equal coupling strengths 
Ji — J2 — J3 = ^ T-T^ the sequel. 

Two Potts-glass neural networks with Hebb learning 
have been studied in the literature. Considering four 
Potts-states the first network [|| is described by the 
Hamiltonian 



P N 

nK = ~—y y -K- 



2N ^ ^ 16 



tADK-v^;) , (2) 



while the second one is given by ^ 

P N 



(3) 



where and are state and pattern vectors taken from 
the set of four-dimensional vectors v = {v*^')} with com- 
ponents vl^^ = ASki — 1 ioT l,k — 1,2,3,4. The main 
difference between the two models is that in the first, 
anisotropic model precisely one specific Potts state is 
favoured at each site, while in the second, isotropic model 
the fact whether or not two neurons are in the same state 
is important. 

Two models can be equivalent at the level of the Hamil- 
tonian or at the level of the free energy. It is clear that 
for the Hamiltonians of the models we have introduced 
above there are one state and p pattern variables associ- 
ated with each of the N sites of the network. Thus the 
Hamiltonians can be written in the form 
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(4) 



''=1 {i.j) 



where mod denotes AT, K or V Z . The energy of the 
interaction between two sites is a sum over patterns of 
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Hmod{C^j) and depends on the state-pattern configura- 
tion C^j of sites i and j. Hence, it is enough to compare 
the Hmod{Cij)- In the case of four state models we are 
considering here, all possible values of Hmod{C^j) can be 
written in the form of a 16 x 16 matrix ( 16 state-pattern 
configurations for a given site). For the sake of easy 
comparison we write down these matrices explicitly 
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(7) 
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where we have used the standard notation c = — c. 

One can see that Hat differs from Hk and Hyz by the 
number of energy levels and by their position in the ma- 
trix. We have not found a transformation of the Hamil- 
tonians removing this difference. Therefore, we conclude 



that at the level of the Hamiltonian the AT neural net- 
work is not equivalent to any of the two four-state Potts 
models. 

In order to find out whether a possible equivalence ex- 
ists on the level of the free energies we start from the 
model with Hamiltonian Tin because the matrix Hk has 
the same global symmetry as Hat- We note that the 
symmetry of 4 x 4 blocks in Hk and Hat is different. It 
is a consequence of the fact that Hat is invariant under 
inversion of all the spins, while Hk is not invariant under 
any permutation of the state variables. The Hamiltonian 
Hvz on the contrary is completely invariant under any 
permutation of those variables. 

As remarked in Hk can be rewritten using two dif- 
ferent types of Ising spins 



(8) 



Applying the usual replica method ||Tl| to calculate the 
quenched average over the patterns, chosen to be inde- 
pendent identically distributed random variables taking 
the values -1-1 and —1 with equal probability, the free en- 
ergy density can be written in the thermodynamic limit 
iV ^ cxD in the form / = lim„^o ~ (f'n/n with 4>„ the 
replicated free energy. For the model at hand, assum- 
ing at first that there is only one condensed pattern, say 
/i = 1, we get 
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1 " 



2 ^"^a + 

a—1 a<b 



^ablab 



9a\ 
4^ 



-TrlnA 



^1 In // exp //?' J2 <ba + la'f^'' ^abKb] 

^ \\{s,a} [ a a<b ) I 



where we have dropped the index 1 and where 

Aab={l-3f3')Sab-f3'q'ab, a,b^l,..., 



The brackets ((••■)) indicate the average over the con- 
densed pattern. As usual /3' is the inverse temperature, 
a' the capacity defined as the number of patterns per 
number of couplings per spin, i.e. a' — 2p/9N, J2{s a} 
denotes the sum over all configurations at one site and 
J2a<b denotes the sum over pairs of different replicas 
a < b. Finally, the set of order parameters is given by 



lab 



' ab 



E + (^') + 

p 



9a' ^ ° 

^^>l 
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where (■ • ■) denotes the thermal average and the brackets 
((• ■ •)) now indicate the average over aU patterns. 

The order parameters m^, and r^f,, and the inverse 
temperature [3' can be rescaled in such a way that the 
resulting replicated free energy density satisfies (j)n,K 
— 3 (pn.AT, with (pn.AT the replicated free energy density 
for the AT neural network. Hereby we have taken into 
account that for the AT neural network model with equal 
coupling strengths and one condensed pattern, the nine 
order parameters (wj^, g^^, r^j,) with = 1,2,3 refering 
to ^, rj and ^rj reduce to three, i.e. {rria, qab,i"ab), where 
a reference to a specific type of pattern is now irrelevant. 
This is due to the fact that for this AT model only states 
satisfying = m^, g^,, = qab, r^b = ^ab, = 1, 2, 3, i.e. 
so-called simple states, mimimizc the free energy. For 
the replica symmetric ansatz this property of the simple 
states has been shown in Q to be related to taking the 
quenched average over just one condensed pattern. Since 
patterns do not carry replica indices, we assume that it 
is also valid in the fully replicated case. 

The proper rescaling is the following : 



/3' = i/3, a'^a. 



(10) 



Next, assuming more than one condensed pattern, the 
order parameters get a vector character in fi and sta- 
ble states for which the mj^ are different for different 
occur. This no longer allows for a reduction of the order 
parameters. We remark that these states have a bigger 
replica symmetric free energy than the one for the simple 
states and, hence, they play a minor role in the thermo- 
dynamics of the model. Nevertheless, they do destroy 
the thermodynamic equivalence with the Potts model. 

In brief, we conclude that the AT neural network 
with equal coupling strengths and one condensed pat- 
tern is thermodynamically equivalent to the four-state 
anisotropic Potts model studied in j|] , in spite of the dif- 
ferent Hamiltonians. In fact, the AT Hamiltonian dll) 



does not contain three-spin interaction terms present in 
(^). We have demonstrated this thermodynamic equiv- 
alence by rewriting the Hamiltonian of the Potts model 
using two different types of Ising variables and calculat- 
ing the replicated free energy. 

These results clarify the resemblance found before 
P,pp^ of the thermodynamic properties of the AT and 
the Potts neural networks. Furthermore, they imply that 
the four-state Potts model described by Hvz is thermo- 
dynamically equivalent to the AT neural network model 
with one condensed pattern only in the limit of low load- 
ing, i.e. for a = 0, or at zero temperature assuming 
replica symmetry, where we know that the fixed-point 
equations for the two four-state Potts models are the 
same, as shown in 
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